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ABSTRACT 


Recent  intensive  study  of  adaptive  (gradient- search)  filtering 
in  the  time  domain  has  not  solved  the  problems  with  rate-of-convergence  pro¬ 
blem,  which  is  a  difficulty  with  this  technique.  A  recent  study  based 
on  a  set  of  time-stationary  synthetic  data  shows  that  the  time-  domain  maximum- 
likelihood  adaptive  filter  converges  very  slowlyr^tcT  the  optjmum  filter.  After 
3  300  iterations  of  adaption  with  an  adaptive  rate  of  10  pcrc-i-ftt  of  maximum  value, 
the  adaptive  filter  is  still  about  4  db  away  from  the  optimum  filter  in  the  sense 
of  mean-square  outputs. 

Time-domain  adaptive  filtering  necessitates  using  only  one  con¬ 
vergence  parameter  for  all  filter  coefficients,  which  may  cause  slow  convergence 
for  some  data.  Frequency- domain  adaptive  filtering  may  solve  this  problem, 
since  different  convergence  parameters  can  be  used  for  different  frequency  com¬ 
ponents.  This  report  describes  a  frequency-domain  maximum-likelihood  adaptive 
filtering  algorithm  analogous  to  the  time-domain  adaptive  algorithm  .  This 
algorithm  was  used  with  a  set  of  synthetic  stationary  data  previously  used  for  a 
time-domain  adaptive -filtering  study.  Different  filter  lengths  and  convergence 
parameters  were  used.  Results  are  compared  with  beamsteer  and  time-domain 
adaptive  filters. 
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SECTION  I 


INTRODUCTION 

This  report  describes  a  maximum- likelihood  filter  design  tech¬ 
nique  using  an  adaptive  algorithm  operating  on  data  in  the  frequency  domain. 

For  a  maximum-likelihood  filter  containing  a  number  of  points  LF  (length  of 
filter)  and  number  of  channels  NC,  the  adaptive  algorithm  in  the  time  domain 
tries  to  find  the  minimum  point  on  an  LF  x  NC  dimensional  quadratic  perfor¬ 
mance  surface  voider  a  system  of  constraints  permitting  the  use  of  only  one  con¬ 
vergence  parameter  for  all  dimensions.  This  may  lead  to  slow  convergence  of 
the  algorithm.  It  was  believed  that  convergence  might  possibly  be  accelerated 
by  adapting  the  filter  in  the  frequency  domain,  where  different  convergence  para¬ 
meters  can  be  used  for  different  frequency  components.  Each  frequency  coqi- 
ponent,  the  minimum  point  on  an  NC  dimensional  quadratic  performance  surface 
is  sought  instead  of  the  minimum  on  an  NC  x  LF  dimensional  surface. 

It  is  hoped  that  decoupling  the  LF  x  NC  problem  into  LF/2  pro¬ 
blems  of  NC  dimension,  each  with  its  separate  constraint  and  convergence  rate, 
will  lead  to  a  better  filter  than  could  be  obtained  by  applying  the  same  amount  of 
work  to  the  LF  x  NC  problem, 

A  frequency-domain  adaption  requires  transforming  the  initial 
time-domain  filter  coefficients  and  time  traces  to  the  frequency  domain  by  direct 
Fourier  transformations.  The  output  of  the  filter  can  then  be  written  as  the 
summation  of  individual  frequency  component  filtering  outputs.  For  each  fre¬ 
quency  component,  an  adaptive  algorithm  can  be  obtained  by  minimizing  the 
square  of  the  absolute  value  of  the  output  at  that  frequency  component,  subject 
to  a  system  of  constraints  in  the  frequency  domain.  The  constraints  in  the  fre¬ 
quency  domain  are  obtained  by  Fourier  transforming  the  time-domain  constraints. 
The  output  of  the  filter  can  be  minimized  by  reducing  each  frequency  component 
output  independently,  assuming  independence  of  the  filter  outputs  of  individual 
frequency  components. 
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The  frequency- domain  maximum- likelihood  adaptive- filtering 
algorithms  developed  in  Section  V,  is  as  follows. 


r-  T  +  1  _  t  1  t. 

i,  k  i,  k  Ck  Vk  ^k  "  Xi,  J 


(1-1) 


and  the  output  of  the  filter  at  time  t  is 

(LF-1)  1/2 

yt  =  yt0 +  2  Re  ^2 
k=  1 


(1-2) 


where 


NC 

x [  -  v*  x* 

k  NC  iL J  l,  k 
i=  1 


F. 


i,  k 


NC 


1  „  t  t 

LF  ILl  ^  i,  k  X  i,  k  ’ 


i: — 1 


th 


l,  ;< 


Re 


the  output  of  k  frequency  component  at  time  t 

is  the  k  frequency  component  of  the  i^  channel 
frequency-domain  data  at  time  t 
is  a  real  or  complex  constant  convergence  para¬ 
meter  for  the  k1^  frequency  component 

t  h  t  h 

is  the  k  frequency  component  of  the  i  channel 

frequency-domain  weight  at  time  t 

means  complex  conjugate 

means  "the  real  part  of" 


Since  the  preceeding  algorithm  is  performed  in  the  frequency 
domain,  F. 1  ^  ,  X.*^  ,  X^  ,  and  y^  numbers  are  all  complex.  The  formula  in 
Equation  1-1  is  similar  to  the  time-domain  maximum- likelihood  adaptive  algor¬ 
ithm,  where  all  variables  are  real  numbers.  Note  that  in  frequency-domain 
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filtering  only  (LF+l)/2  independent  frequency  components  correspond  to  an  LF- 
point  time -domain  filter.  This  effectively  makes  the  dimensions  of  a  frequency- 
domain  filter  only  about  half  those  of  a  time-domain  filter  and  components  for 
the  complex  operations  in  the  frequency  domain.  Thus  if  transformations  of 
input  data  to  the  frequency  domain  are  excluded,  computations  of  time  and 
frequency-domain  algorithms  are  approximately  the  same. 

Equation  1-1  shows  that  should  be  selected  to  be  inversely 
proportional  to  the  power  of  input  data  at  frequency  component  k  in  the  filter. 

It  is  very  difficult  to  choose  a  proper  if  nothing  is  known  about  the  power 
spectrum  of  the  input  data.  To  avoid  this  difficulty,  Equation  1-1  can  be  modified 
to 


,t+l 

j.  k 


=  F 


i,  k 


2  — t  — t'1' 

Ncnx :  ) 

4  ^ 


t  r  "y"  t 

V l  x  I, 


XU] 


(1-3) 


To  keep  the  algorithm  stable,  the  maximum  value  of  is  approximately  1. 

In  this  report,  Equation  1-3  is  used  to  adapt  filters  in  the  fre¬ 
quency  domain  with  a  dimension  of  13  channels,  29  points,  45  points,  and  59 
points.  Afte r  ^certain  number  of  adaptive  iterations,  the  last  filter  is  trans¬ 
formed  back  to  the  time  domain  and  fixedly  applied  to  the  time-domain  data. 
The  mean-square  output  and  output  spectrum  of  frequency-domain  filters  are 
compared  with  those  of  the  time-domain  adaptive  filters  and  the  beamsteer 
processor. 
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SECTION  II 


EXPERIMENTAL  RESULTS 

This  experiment  used  a  set  of  synthetic  stationary  data  having 

the  same  covariance  matrix  as  the  ensemble  of  selected  noise  samples  from 

2 

a  short-period  seismic  array.  The  data  contain  13  channels,  with  3300  sample 
points  per  channel  and  a  72-msec  sample  period. 


Time  traces  were  transformed  into  the  frequency  domain  accord¬ 
ing  to  Equation  1-3,  and  the  initial  filter  was  obtained  by  transforming  a  time- 
domain  beamsteer  processor  to  the  frequency  domain  using  Equation  6.  The 
resulting  frequency- domain  data  was  written  on  magnetic  tape  so  that  the  Fourier 
transform  need  not  be  repeated. 


Three  filters  with  lengths  of  2  9  points,  45  points,  and  59  points 
were  tried.  For  each  filter  different  sets' of  convergent  parameters  were  applied 
and  the  data  was  passed  several  times.  After  one  or  more  passes,  the  last 

filter  was  transformed  back  to  the  time  domain  and  fixedly  applied  to  the  time 

»  » 

traces.  The  output  spectra  were  compared  with  those  of  beamsteer  and  time 
£  domain  adaptive  filtering.  The  results  of  the  time-domain  adaptive  filtering 
used  here  as  a  reference  were  obtained  by. adapting  3300  points  with  a  con¬ 
vergent  rate  of  approximately  10  percent  of  its  estimated  maximum  rate\ 


A.  29-POINT  FILTER 


\ 


A  29-point  filter  has  15  independent  frequency  component 
(k=0-14)  each  representing  a  band  of  about  .47  Hz.  The  sequential  transforms 
were  taken  with  a  15  point  overlap,  thus  3300  data  points  provided  220  updates 

at  each  frequency.  After  making  five  passes  thru  the  data  with  various  con- 

,  *8 
verged  rates  the  measured  mean  square  output  is  1.381  x  10  compared  with 

8  1 

2.  185  x  10  for  the  summation  and  8.54  x  10  for  the  29-point  time  domain 
adaptive  fTter. 


These  emperical  results  show  that  the  frequency-domain 
maximum-likelihood  adaptive  filter  (FDMLAF)  does  not  perform  better  than 
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the  time-domain  maximum- likelihood  adaptive  filter,  but  the  question  of  how 
well  it  converges  to  the  frequency-domain  maximum- likelihood  optimum  filter 
(FDMLOF)  has  not  been  answered.  A  comparison  of  the  mean  square  output 
(MSO)  of  FDMLAF  and  FDMLOF  at  each  of  the  sampled  frequencies  was  made. 
Based  on  the  covariance  matrix  of  the  data  used  for  the  experiment,  15  FDMLOF's 
can  be  designed,  each  with  the  frequency  corresponding  to  one  of  the  frequencies 
sampled  in  the  29-point  FDMLAF. 

The  MSQ's  of  the  FDMLAF  and  FDMLOF  at  each  sampled  fre¬ 
quency  are  shown  in  Figure  II— 1 . 


ADAPTIVE  FILTER 


OPTIMUM  FILTER 


FREQUENCY  (Hz) 


Figure  -II-  1 .  MSO  of  FDMLOF  and  FDMLAF 
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Figure  II- 3.  Output  Spectrum 
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Compared  with  FDMLOF,  the  MSO  of  the  FDMLAF  is  2  to  3  db  worse  in  the 
0~1-Hz  band,  0.  5  to  1.5  db  worse  in  1~2  Hz  band,  and  2  to  5  db  worse  for  fre¬ 
quency  above  2  Hz.  These  two  curves,  indicate  that  FDMLAF  does  not  converge 
to  the  FDMLOF  very  well. 

B.  45-POINT  FILTER 

The  45-point  filter  has  23  independent  frequency  components  in 
the  frequency  domain.  Fifteen  data  points  were  overlapped  for  two  consecutive 
Fourier  transforms  of  the  time  traces,  and  140  updates  were  available  at  each 
frequency  in  one  pass  thru  the  data.  Ten  passes  were  made  for  this  filter. 

Relatively  larger  convergent  parameters^are  used  in  the  0.  3-  to  1.5-Hz  frequency 

> 

components,  where  heaJristeer  and  time  domain  adaptive  filters  have  very  poor 
performance. 

The  best  filter  obtained  after  ten  passes  thru  the  data  gave  a 

3  3 

mean  square  output  of  1.  097  x  10  as  compared  with  2.  185  x  10  for  the  sum 
7 

and  8.45  x  10  for  the  time  domain  adaptive  filter. 

C.  59-POINT  FILTER 

V. 

Overlapping  30  data  points  for  two  consecutive  Fourier  transfor¬ 
mations  of  time  series  100  provided  update  points  in  the  frequency  domain  per 

pass  thru  the  data.  Six  passes  were  made.  At  the  end  of  the  6  ^  pass  the  mean 

8 ' 

square  output  was  1.  054  x  10  . 

Figure  H-2  shows  the  power  spectra  of  a  single  channel,  the  summa¬ 
tion,  and  the  time  domain  adaptive  filter  output.  Figures  II-3,  II-4,  and  II- 5  show  the 
spectra  for  the  single  channel,  summation  and  29  pt,  45  pt  and  59  pt  adaptive 
filters  respectively.  These  figures  indicate  that  the  2  9  point  time  domain 
adaptive  filter  is  superior  to  the  frequency  domain  filter  at  essentially  all  fre¬ 
quencies.  This  is  true  in  spite  of  the  fact  that  the  time  dortiain  filter  was  achieved 
in  one  pass  thru  the  data  as  opposed  to  several  passes  for  the  frequency  domain 
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SECTION  III 
CONCLUSIONS 


The  experiment  using  the  synthetic  stationary  data  and  the 
selected  convergent  parameters  on  the  derived  frequency  domain  maximum- 
likelihood  adaptive  algorithm  leau?  to  the  following  conclusions: 


•  The  frequency-domain  adaptive  filter  converges 
slower  than  the  time-domain  adaptive  filter  for 
the  convergent  parameters  used  in  this  experi¬ 
ment.  It  does  not  converge  to  the  frequency-domain 
optimum  filter  very  well.  This  may  be  due  to  bias 
or  to  slow  convergence.  A  detailed  study  of 

this  "convergence"  problem  for  both  frequency 
and  time  domain  algorithms  would  be  valuable. 

•  For  frequency-domain  adaptive  filtering  the  filter 
must  be  long  enough  to  represent  the  characteristics 
of  the  spectrum  of  the  data.  The  data  used  in  this 
experiment  requires  a  filter  at  least  45  points  long  to 
produce  a  reasonably  good  result 

•  The  time-domain  adaptive-designed  filter  rejects 
noise  betteKon  all  frequency  components  than  the 
frequency-jicmain  adaption  designed  filter,  especially 
for  the  lines 

•  The  frequency-domain  adaptive -designed  filter  can 
preserve  the  signal  very  well,  since  it  can  hold  the 
constraints  perfectly 
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MATHEMATICAL  DEVELOPMENT  OF  FREQUENCY- DOMAIN 
MAXIMUM- LIKELIHOOD  ADAPTIVE  FILTERING  ALGORITHM 


The  time  domain  maximum -likelihood  adaptive  filter  is  derived 

v- • 

by  minimizing  the  output  y  of  a  linear  multichannel  filter  _f 


t 

y 


NC  LF 


x 

i.  t-j 


subject  to  a  system  of  constraints 


where 


M  f  =  a 


x  i  is  the  input  data  vector 
NC  is  the  number  of  channels 
LF  is  the  length  of  filter 


NC 


I  is  a  LF  by  LF  identity  matrix 


s  =  LF/2 


(4-1) 


(4-2) 


(4-3) 


The  resulting  adaptive  algorithm  is 


(4-4) 


where  I  is  a  LFxNC  by  LFxNC  identity  matrix,  U  is  a  square  rpatrix  with  all 

elements  equal  to  1  and  dimension  LFxNC,  and  B  is  a  convergent  parameter. 

■» 

Here  we  derive  a  similar  adaptive  algorithm  in  the  frequency 


I 

domain. 
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IV-2 


where 


N 


1,0 

Rl,l 

R1,LF-1 

2,0 

4 

R2,l  -• 

R2,  LF-1 

1 

and 


Lrlf,o  rlf,  K‘ 


N  =  £  N '  !  n'| - ;N'  J 

Then,  Equation  4-2  can  be  written  as^ 

Os 

(N*  F)  =  a  flr  NT  F  =  £ 


where 


J_  *  }  * 

LF 

0  =  LF  a 


R 


LF,  LF  - 1 


■ 

f; 


We  assume  that  ajl  frequency  components  of  y*  are  independent, 
i.e.^’s  are  independent.  Then  (y*  )2  may  be  minimized  by  minimizing  each 
y^1 1 ^independently;  i.e.,we  may  minimize  y*  y^  subject  to  the  constraint 


where 


~  *  ~  X 

flk  Fk  ■  4 


4  ■  si,k 


LF  - 1 


LF - 1  - _ 

E  si: 

kTo  ' 


0  .  =  LF  a. 

i,  k  l 


i.k  =  0 


ik  ■  (FiRk  ■  iFiRk 


fiR  g  1  \T 

bF,  k  lF,  k 


(4-10) 
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F  and  F  are  the  real  and  imaginary  part  of  F.  .  ,  respectively.  Let 

1  ’  J  1  •  J  1 ,  j 


and 


Then 


where 


-fc, 
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(4-11) 


Re  and  Im  represents  "the  real  part  of"  and  "the  imaginary  part  of". 
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i  <T 


we  have 


In  order  to  find  the  Langrangian  multiplier  »  let  ^  ^  =  0*  Then 


T,  -1 


X, 
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"I 

4  4  J  fik  4 
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Substituting  Equation  -12  into  Equation  -11,  we  have 

T_  .  T  -1 


I  T  T  - 1 
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After  removing  the  redundant  rows  of  »  we  have 
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and  Equation  4-13  becomes 
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Y  t, 
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The  adaptive  algorithm  can  be  written  as 
~trl  ~t  2  Bk  „  , 
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(4-14) 
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_  t+1  „  t  „ 

Fi,k  ■  Fi.k *  Ck 


Fk  Lxk  -  x 


*1  ' 

i.kj  * 


(4-15) 


where 


.  NC 

xl  -  —  v  X  1 
*k  "  NC  4-f  i,k 
i=l 


'k  LF 


Since  y 


♦  '  ^ 

t  ^  t 

yLF  ^  y^is  rea*’  we  can  wr*te  Equation  5-8  as- 


t  t 

y  =  y  +  2  Re 
0 


(LF-l)/2 

(5  <] 


(4-16) 


Since  F*  =  F.  _  _  ,  and  F  *  is  real,  we  only  need  to  calculate 
i,  k  l,  LF-k  i,0 

Equation  4-15  for  k=0,  1, - ,  (LF-l)/2. 
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